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A  theorem  with  a  number  of  equivalent  alternatives  is  proposed  as  an 
extension  of  the  classical  Gordan  theorem  of  the  alternative.  The  theorem  can 
handle  nonzero  unrestricted  variables  which  cannot  be  directly  treated  by 
ordinary  theorems  of  the  alternative.  Like  the  Gordan  theorem,  the  extended 
theorem  has  the  stability  feature  that  small  perturbations  in  the  data  will 
not  invalidate  an  alternative  that  is  in  force.  The  theorem  has  useful 
applications  in  establishing  the  boundedness  and  uniqueness  of  feasible  points 
of  polyhedral  sets  and  of  solutions  to  linear  programming  problems. 
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SIGNIFICANCE  AND  EXPLANATION 


In  deriving  optimality  conditions  and  duality  relations  of  optimization 
theory  certain  theorems,  called  theorem  of  the  alternative,  play  a  key  role* 
These  theorem  characterize  the  solvability  of  a  certain  system  of  inequalities 
by  the  unsolvability  of  a  related  system  of  inequalities*  We  extend  here  one 
of  the  fundamental  theorems  of  the  alternative  in  such  a  way  that  it  can 
handle  certain  types  of  variables  not  easily  handled  before*  As  applications 
we  can  give  conditions  which  characterize  uniqueness  or  boundedness  of 
solution  of  linear  programming  problems*  Elsewhere  the  theorem  has  been  used 
by  chemical  engineers  to  give  conditions  under  which  maximum  energy  recovery 
is  possible  in  a  heat  exchanger  network  under  a  certain  disturbance  range* 


The  responsibility  for  the  wording  and  views  expressed  in  this  descriptive 
summary  lies  with  MRC ,  and  not  with  the  author  of  this  report. 


A  STABLE  THEOREM  OF  THE  ALTERNATIVE: 
AN  EXTENSION  OF  THE  GORDAN  THEOREM 

0.  L.  Mangasarian 


1 •  Introduction 

Theorems  of  the  alternative  play  a  key  role  in  mathematical  programming 

[4,  8,  2,  7].  Among  the  best  known  and  very  useful  theorems  of  the 

alternative  is  the  Gordan  theorem  [6,  4,  8]  which  states  that  for  any  m  *  n 

real  matrix  D  the  following  are  equivalent: 

(i)  Oy  >  0  has  a  solution  y  in  Rn 

(ii)  DTv  =  0,  0  /  v  >  0/  has  no  solution  v  in  R®. 

Here  Rn  denotes  the  n-dimensional  real  Euclidean  space  and  the  superscript 

T  denotes  the  transpose.  These  two  alternatives  however  are  not  the  only 

ones  that  can  be  stated  for  the  Gordan  theorem.  For  example  it  can  be  easily 

shown  [5]  that  (i)  and  (ii)  are  also  equivalent  to  the  following 

(iii)  For  each  (c,h)  in  Rm+n  the  linear  program 

T  T 

max  (c  v|D  v  *  h,  v  >  0} 
m  = 

V€  R 

is  either  infeasible  or  has  a  nonempty  bounded  optimal 
solution  set. 

It  is  also  elementary  to  verify  that  (i)  is  also  equivalent  to 

(iv)  Dy  >  c  has  a  solution  y  in  Rn  for  each  c  in  Rra 

and 
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(v)  Dy  >  0  has  a  solution  y  in  Rn  for  each  m  x  n  matrix  D 
such  that  HD  -  Dfl  <  6  for  some  6  >  0. 

Here  #•>  denotes  any  matrix  norm*  The  existence  of  these  various  equivalent 
alternatives  prompts  one  to  look  for  a  general  type  of  theorem  which  subsumes 
the  Gordan  alternatives*  One  such  very  general  extension  can  be  achieved  by 
using  the  general  regularity  theory  of  Robinson  [12,  13].  Our  approach  here 
employs  the  more  basic  framework  of  the  classical  theorems  of  the  alternative 
[4,  8]  to  arrive  at  the  desired  extension.  A  key  role  in  the  extension  is 
played  by  the  stability  alternative  (v)  above,  namely  that  Dy  >  0  has  a 
solution  y  in  Rn  for  all  D  in  Rmxn  (the  space  of  m  x  n  real 
matrices)  that  are  sufficiently  close  to  D.  This  alternative  shows  that  the 
set  of  data  (matrices  in  Rmxn)  for  which  alternative  (i)  holds  in  an  open 
set  in  By  contrast  it  can  be  shown  by  means  of  simple  examples  that  the 

set  of  data  satisfying  either  of  the  Farkas  theorem  alternatives  [3,  8]* 


Ax  >  0,  bTx 

<  0 

has  a  solution 

X 

in  Rn, 

or 

ATu 

=  b,  u  >  0 

has  a 

solution  u 

in 

Rm,  where  A 

is 

.  mxn 

in  R 

and 

b 

is  in  Rn, 

is  not  an 

open  set  in  Rmn*n. 

In  view  of  the  important  role  played  by  the  stability  alternative  (v)  we 
shall  term  our  extension  of  the  Gordan  theorem,  Theorem  1  below,  a  stable 
theorem  of  the  alternative.  The  aptness  of  this  terminology  will  be  more 
apparent  from  Theorem  2  of  the  next  section  which  shows  that  if  any  one  of  the 
alternatives  of  Theorem  1  holds  then  they  all  hold  for  sufficiently  small 
perturbations  of  the  data.  In  Section  3  of  the  paper  we  exhibit  some 
applications  of  the  stable  theorem  of  the  alternative  in  the  form  of 
characterizations  of  boundedness  and  uniqueness  of  solution  of  linear 
Drograms.  We  also  mention  a  practical  application  in  engineering. 


In  order  to  be  concrete  we  give  now  definitions  of  a  theorem  of  the 


alternative  and  a  stable  thoerem  of  the  alternative* 

Definition  1*  A  theorem  of  the  alternative  is  an  equivalence  relationship 
between  the  solvability  of  a  system  of  linear  equalities  and  inequalities  and 
the  unsolvability  of  a  related  system  of  linear  equalities  and  inequalities* 
The  solvability  of  the  first  system  and  the  unsolvability  of  the  second 
system  will  be  referred  to  as  equivalent  alternatives  or  more  simply 
alternatives* 

Definition  2*  A  stable  theorem  of  the  alternative  is  a  theorem  of  the 
alternative  with  more  than  two  equivalent  alternatives  and  such  that  if  one  of 
its  alternatives  holds  then  it,  and  consequently  all  the  other  alternatives, 
hold  for  a? 1  sufficiently  small  but  arbitrary  perturbations  of  the  (constant) 
data  constituting  the  linear  equalities  and  inequalities  of  the  alternatives* 
Some  of  the  interesting  features  of  stable  theorems  of  the  alternative 


are: 

(a)  They  often  involve  nonzero  unrestricted  variables  that  are  usually 
not  handled  by  ordinary  theorems  of  the  alternative.  (See 
alternative  (i1)  of  Theorem  1  below.) 

(b)  They  give  useful  existence  properties  for  perturbations  of  systems 
of  linear  inequalities  and  equalities.  (See  alternatives  (i),  (ii) 
and  (iv)  of  Theorem  1  below.) 

(c)  They  give  useful  boundedness  results  for  certain  polyhedral  sets  and 
linear  programs.  (See  alternatives  (v1)  and  (vii1)  of  Theorem  1  and 
also  Theorem  2,  below.) 

We  briefly  describe  now  the  notation  used.  All  matrices  and  vectors  are 
real.  For  the  m  x  n  matrix  A  we  write  A  c  R™  n  and  denote  row  i  by 


element  j  is  denoted 


For  x  in  the  real  n-dimensional  Euclidean  space  Rn, 
by  Xj«  All  vectors  are  column  vectors  unless  transposed  by  the  superscript 
T.  For  I  c  {1,..*,m}  and  J  <=  Aj  denotes  the  submatrix  of  A 

with  rows  A*  ,  i  e  I;  A  denotes  the  submatrix  of  A  with  columns  A  , 

i  •  j  •  j 

j  e  J;  Ajj  denotes  the  submatrix  of  A  with  elements  A^,  i  el,  j  e  J 

and  Xj  denotes  xi#  i  e  J.  lx  I  will  denote  an  arbitrary  but  fixed  norm 

on  Rn  and  the  corresponding  induced  matrix  norm  max  I Ax I  will  be  denoted 

lxl»1 

by  IAI •  For  brevity  we  shall  often  omit  mentioning  the  dimensionality  of  a 
vector  or  a  matrix,  it  being  obvious  from  the  context.  The  vector  e  will  be 
a  vector  of  ones  in  the  appropriate  Euclidean  space. 


2.  A  stable  theorem  of  the  alternative 


We  begin  with  our  principal  result  which  subsumes  the  Gordan  theorem  and 
which  gives  many  useful  equivalent  alternatives.  Some  of  these  equivalences 
can  also  be  derived  from  Robinson’s  general  regularity  approach  which  uses 
multifunction  theory  [13]  and  some  from  Rockafellar* s  convex  analysis  results 
[14].  For  example  the  equivalence  between  (iii),  ( i 1 )  and  (i)  of  Theorem  1 
below  can  be  established  after  some  work  by  using  the  equivalence  between  I, 

II  and  III  respectively  of  Theorem  3  of  [13] •  Similarly  the  equivalence 
between  (i1)  and  (v1)  of  Theorem  1  below  can  also  be  established  by  using 
Rockafellar ' s  Theorem  8.4  [14]  which  states  that  the  boundedness  of  a  nonempty 
closed  convex  set  is  equivalent  to  its  recession  cone  containing  the  origin 
only.  In  keeping  with  the  spirit  of  theorems  of  the  alternative  our  proofs 
here  will  rely  mainly  on  these  theorems. 

Theorem  1  (A  stable  theorem  of  the  alternative).  Let  A,  B,  C  and  D  be 

m^xn^  m-|  xn2  m2*nl  m2Xn2 

fixed  matrices  in  R  ,  R  ,  R  and  R  respectively  and  let 

m «  nu 

a  and  c  be  fixed  vectors  in  R  and  R  4  respectively.  The  following 
are  equivalent: 


(i)  Ax  +  By  =  a  +  yb 
Cx  +  Dy  >  c  +  yd 
x  >  0 

SB 

1  >  y  >  0 

has  solution  (x,y,y) 
for  each  (b,d) 


( i * )  ATu  +  CTv  <  0 

T  T 

B  u  +  D  v  =  0 

T  T 

a  u  +  c  v  >  0 

v  >  0 

<u,v)  Jt  0 

has  no  solution  (u,v) 


(ii)  Ax  +  By  ■  a 
Cx  +  Dy  >  c 
x  >  0 

has  solution  (x,y) 
for  each  ( A,B,C,D,a,c) 
such  that: 


-T  -T 
ii')  A  u  +  C  v  < 


-T  -T 
B  u  +  D  v  *  0 

~T 

a  u  +  c  v  >  0 


v  >  0 

has  no  solution  (u,v) 
for  each  (A,B,C,D,a, c) 
such  that: 


max{  ||a-a||,  Mb— B II ,  II C— C II ,  ||d-d||  ,  ||a-a|| ,  ||c-c||  }  <  e  for  some  e  >  0 


(iii)  Ax  +  By  =  a 
Cx  +  Dy  >  c 
x  >  0 

has  solution  (x,y)  and: 


(iii*) 


-A  u  -  C  v 


T  T  l 

0  ?  a  u  +  c  v  >  0 


T  T 

B  u  +  D  v  =0 


has  no  solution  (u,v)  and: 
rows  of  [A  B]  are  linearly  independent 


AX 

+  By  = 

a 

(iv') 

/  tT  -t 

/-A  U  -  C  V 

o  t 

-T  -T 

Cx 

+  Dy  > 

c 

a  u  +  C  v 

x  >  0 

has  solution  (x,y)  and 
rows  of  [A  B]  are  linearly 
independent  for  each  (A,B ,C,D,a,c) 
such  that: 


-T  -t 
B  u  +  D  v  =0 


has  no  solution  (u,v)  and 
rows  of  [A  5]  are  linearly 
independent  for  each  ( A,B , C, D, a,c) 
such  that: 


max{  1 1  A—  A 1 1  ,  1 1 B— B 1 1  ,  J|  C— C  ||  ,  1 1 D—  D 1 1  ,  ||a-a||  ,  ||c-c|| }  <  <5  for  some  6  >  0 


-6- 


(v*)  For  each  (g,h,a)  the  set 

r 


S(g,h,a)  =  \(u,v) 


T  T 

Au  +  Cv<g>^ 

T  T 

B  u  +  D  v  =  h 


T  T  / 
a  u  +  c  v  >  a  I 


v  >  0 


is  empty  or  bounded 
(vi1)  For  some  (g,h,a)  the  set 

S(g,h,cx)  of  (v* )  is  a  singleton. 


r 

f 

Ax  +  By  =  a  ^ 

T  ,  T 

~T  ~T 

q  x  +  h  v 

l  max  < 

a  u  +  c  v 

1 

Cx  +  Dy  >  c 

| 

V, 

x  >  0  J 

(vii)  There  exists  an  e  >  0  such  that  (vii*) 
for  each  (a,c)  satisfying 
||  (a,c)  -  (a,c)  ||  <  e  and  for 
each  (g,h)  the  linear  program 


x/y 


is  feasible  and  either  its 
objective  function  is  unbounded 
below  or  the  set  of  dual  optimal 
multipliers  is  nonempty  and  bounded, 
(viii)  There  exists  an  e  >  0  and  (viii1) 

(g,h)  such  that  for  each 
(a,c)  satisfying 
||  (a,c)  -  (a,c)  [|  <  e  the  linear 
program  of  (vii)  has  a  unique 
dual  optimal  multiplier. 


There  exists  an  e  >  0  such  that  for 
each  (a,c)  satisfying 

||  (a,c)  -  (a,c)  ||  <  e  and  for 
each  (g,h)  the  linear  program 


T  T 

A  u  +  C  v  <  g 


T  T 

B  u  +  D  v  =  h 


v  >  0  ) 

is  either  infeasible  or  has  a 
nonempty  bounded  optimal  solution 
set . 

There  exists  an  e  >  0  and  (g,h) 
such  that  for  each  (a7c)  satisfying 
||  (a,c)  -  (a,c)  ||  <  e  the  linear 
program  of  (vii1)  has  a  unique 
solution . 
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Proof 


(i)  <==>  (i')  :  (i*)  is  equivalent  to 

mm  TT  TT  TT 

A  u  +  C  v  <  0,  Bu+Dv-O,  -a  u  -  c  v  <  0 ,  -v  <  0 ,  -r  u  -  s  v  <  0 

m.+n- 

not  having  a  solution  (U/V)  for  each  (r,s)  in  R  .By  Motzkin's 

theorem  of  the  alternative  [11,8]  this  is  equivalent  to 

Ax  +  By  -  a£  -  r  =  0,  Cx  +  Dy  -  c£  -  s  >  0,  x  >  0,  £  >  0 

_  m«+n  ^ 

having  a  solution  (x,y,£)  for  each  (r,s)  in  R  •  By  defining  b  =  r-a 

and  d  -  s-c  this  is  equivalent  to 

Ax  +  By  =  a(£+1)  +  b,  Cx  +  Dy  >  c(£+1)  +  d,  x  >  0,  £  >  0 

_ 

having  a  solution  (x,y,£)  for  each  (b,d)  in  R  •  This  is  equivalent 

x  y  1 

to  (i)  if  we  make  the  identifications  x  =  — — ,  y  =  — *—  and  y  =  — —  >  0. 

i+£  1+C  1+5 

(ii)  <==>  (ii'):  By  Motzkin's  theorem. 

(iii)  <==>  (iii'):  By  Motzkin's  theorem. 

(iv)  <==>  (iv'):  By  Motzkin's  theorem. 

(vii)  <==>  (vii'):  By  linear  programming  duality  [1J. 

(viii)  <=«>  (viii'):  By  linear  programming  duality. 

(i9)  -->  (ii):  If  (ii)  did  not  hold  then  there  exists  a  sequence 
{ Ai ,Bi /Ci , D* ,ai ,c^} ,  i  =  1,2,...,  converging  to  ( A, B,C, D,a , c)  such  that 
f  or  i  —  1,2,..#, 

A*x  +  Biy  =  Cix  +  D*y  >  c*,  x  >  0 

has  no  solution  (x,y).  By  Motzkin's  theorem  this  is  equivalent  to 
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Hence  it  follows  that  x  =  x  +  —  >  0  and  y  =  y  satisfy  the  conditions  of 
( iii )  • 

(iii*)  *«>  (iv):  Since  the  set  of  matrices  with  full  row  rank  is  an  open  set 
it  follows  that  [A  B]  is  of  full  row  rank  for  sufficiently  small  6  >  0. 
Now  if  (iv)  does  not  hold  there  must  exist  a  sequence  {A1^B1/C1/D1,a1#c1} / 
i  «  1,2,...,  converging  to  ( A,B,C,D,a,c)  such  that  for  i  =  1,2,..., 

A*x  +  B*y  =  a1,  C1x  +  D*y  >  c1 ,  x  >  0 
has  no  solution  (x,y).  By  Mot2kinfs  theorem  this  is  equivalent  to 
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i  u* 

having  a  solution  (u*,v*)  for  i  *  1,2,...  •  Letting  u  *  — j — — , 

lu  ,vX 1 


-i 

v 


i  i 


it  follows  by  the  Bolzano-Wieirstrass  theorem  that  there 


exists Ban' accumulation  point  (u,v)  of  {(u*,v*)}  satisfying 

/  _T—  J?-' 

-A  u  -  C  v 

T—  T —  I  T—  T — 

au  +  cv  I  >  0  ,  B  u  +  D  v  ■  0,  lu,v)  *  1 


If  v  /  0  we  contradict  If  v  *  0  and  0  j*  -A  u  >  0,  then 

T*—  T—  — 

a  u  >  0  and  B  u  *  0,  and  again  we  contradict  (Iii1)*  Finally  if  v  *  0 

T—  t—  •“ 

and  -A  u  **  0,  then  B  u  *  0,  and  Bui  “  1  which  contradicts  the  linear 
independence  of  the  rows  of  [A  B] . 

( iv)  “>  (iii):  Set  A  -  A,  B  **  B,  C  *  C,  D  =  D,  a  =  a  and  c  *  c. 

(iii)  *=»>  (i):  Let  (b,d)  be  in  R  1  ^ .  Because  the  rows  of  [A  B] 
are  linearly  independent  there  exists  (x,y)  such  that  Ax  +  By  *  b.  Let 
(x,y)  satisfy  Ax  +  By  *  a,  Cx  +  Dy  >  c,  x  >  0.  Then  for  sufficiently  large 
positive  X  we  have  X  >  1  and 

A(x+Xx)  +  B(y+Xy)  *  b  +  Xa,  C(x+Xx)  +  D(y+Xy)  >  d  +  Xc,  x  +  Xx  >  0 

1  x+  Xx  v+Xv 

Hence  dividing  by  X  and  defining  y  =  x  =  — — ,  y  «  - we  obtain  (i). 

( i 1 )  =*>  ( vi • ) :  Take  g  *  0 ,  h  *  0  and  a  *  0  in  ( vi ' )  then  by  ( i • ) 

S(0,0,0)  »  {0}. 

(vi1)  (iii'):  Suppose  not,  then  either  the  rows  of  [A  B]  are  linearly 

dependent  or  there  exist  <u,v)  satisfying 

,  T-  T-\ 

-A  u  -  C  v  \ 


0  ^  I  aTu  +  cTv  >  0  ,  BTu  +  DTv  *  0 
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In  the  former  case  there  exists  a  u  j*  0  such  that  A  u  ■  0,  B  u  ■  0  and 
T— 

a  u  >  0,  and  hence  the  set  S(g,h,a)  is  empty  or  unbounded  for  each 
n1+n2+1  - 

(g#h,a)  in  R  because  S(g,h,a)  +  X(u,0)  c  S(g,h,a)  for  X  >  0. 

Similarly  in  the  latter  case  the  set  S(g,h,a)  is  empty  or  unbounded  for  each 

n  4  ^  1  <y 

(g*h,a)  in  R  because  S(g,h,oO  +  X(u,v)  c  S(g,h,a)  for  X  >  0. 

Hence  in  both  cases  we  contradict  (vi1)* 


nl+n2+1 

(i1)  “>  (v'):  Suppose,  not,  then  for  some  (g,h,a)  in  R  the  set 

S(g,h,a)  is  nonempty  and  unbounded*  Hence  there  exists  a  sequence 
{(ui,vi)},  (ui,vi)  /  0,  i  -  such  that  {lu*,v*l}  -►  «  and  for 

i  *  1,2,..., 


_T  i  T  i 
A  u  +  C  V 

Hu1  ,vi  H 


Uu1  jV1  II 


T  i  T  i 
B  u  +  D  v 

„  i  i  „ 

Hu  ,v  H 


B  i  1/ 
Hu  ,v  H 


T  i  ,  T  i 
a  u  +  c  v 

u  i  i 
Hu  ,  v  H 


„  i  i  i  „ 

Hu  ,  v  H  Hu  ,  v  H 


>  0 


Hence  by  the  Bolzano-Wieirstrass  theorem  there  exists  a  (u,v)  such  that 
ATu  +  CTv  <  0,  +  DTv  =  0,  aTu  +  cTv  >  0,  v  >  0,  Hu,v)  H  *  1 

which  contradicts  (!')• 

(v*)  ==>  (i')s  If  not,  then  there  exist  (u,v  )  satisfying 

A^u  +  CTv  <  0,  BTu  +  DTv  =  0,  aTu  +  c^v  >  0,  v  >  0,  (u,v)  /  0 


and  hence  for  (g,h,a)  35  (0,0,0),  S( 0,0,0)  is  nonempty  and  unbounded  because 
X(u,v)  c  S ( 0 , 0 , 0 )  for  X  >  0.  This  contradicts  (v'). 

(i»)  ==>  (vii’)s  Suppose  not,  then  for  each  e  >  0  there  exists  (a,c)  such 
that  H(a,c)  -  (a,c)U  <  e  and  some  (g,h)  such  that  the  linear  program  of 
(vii1)  is  feasible  and  either  has  an  unbounded  optimal  solution  set  or  no 


optimal  solution 


Hence  for  each  e  >  0  there  exists  an  ot  (a  being  the 


maximum  of  the  linear  program  of  (vii* )  if  it  has  a  solution,  else  a  is  any 
real  number)  and  a  sequence  {(uSv*)},  (uSvS  /  0,  i  *  1,2,...,  such  that 
{Du^rV^H}  ♦  »  for  i  *  1,2,...,  and 


T  i  T  i 
A  u  +C  v 

.  i  i  B 

Hu  ,  v  II 


i  *  ii 

Du  ,  v  I 


T  i  T  i 
B  u  +D  V 

„  i  iB 
Bu  ,  v  I 


B  i  i  '  i  i. 
Hu  ,  v  I  lu  ,  v  I 


yr  i  -t  i 
.  ^  a  u  +c  v 

i  °'  i  i  * 

lu  ,v  I 


luSvS 


It  follows  by  the  Bolzano-Wieirstrass  theory  that  for  each  e  >  0  there 

#S* 

exists  a  (u,v)  such  that 

~  -JP-*  -w 

A  u  +  C  v  <  0,  Bu+Dv-0,  v>0,  a  u  +  c  v  >  0,  lu,vl  *  1 
Now  by  letting  e  approach  zero  and  noting  that  iu,vl  «  lu(e),  v(c)l  *  1 
and  B(a,c)  -  (a,c)  I  <  e  we  obtain  once  again  by  the  Bolzano-Wieirstrass 
theorem  that  {(u(e),  v(e))}  (u,v^  and  that 

*p* <p—  Ip __  ip —  Ip  —  _  

A  u  +  c  v  <  0 ,  B  u  +  D  v  »  0,  v  >  0,  a  u  +  c  v  >  0,  lu,vl  *  1 
which  contradicts  ( i' ) • 

(vii)  ==>  (i)j  Evident.  Take  y  *  minf  .  C-_,  1} 

iD,af 

(viii1)  ==>  (vi'):  Take  a  *  a,  c  *  c  and  define  a  to  equal  the  maximum  of 
the  linear  program  of  (vii*)  which  by  assumption  has  a  unique  solution.  The 
set  S(g,h,a)  of  (vi#)  now  consists  precisely  of  this  unique  point. 

(i»)  ==>  (viii*):  From  (i1)  we  have  that  the  origin  is  the  unique  solution  of 
the  linear  program 


max 

u,v 


-T 

a  u  + 


-T 
C  V 


T  T 

A  u  +  C  v  < 

T  T 

B  u  +  D  V  « 

v  > 


0 

0 

0 


for  ll(a,c)  -  (a,c)H  <  e  and  any  e  >  0  because  its  feasible  reaion  contains 
the  origin  only.  Hence  (viii1)  holds  for  (g,h)  ■  (0,0). 


□ 
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We  note  in  Theorem  1  above  that  condition  (iv)  is  a  reproduction  of  the 
openness  condition  (iii)  with  A,  B,  C,  D,  a,  c  replacing  A,  B,  C ,  0,  a,  c 
respectively.  From  this  we  can  immediately  draw  the  following  reolication 
result. 

Theorem  2  (Replication  theorem).  If  any  of  the  alternatives  of  Theorem  1 
hold,  then  all  of  them  hold  with  A,  B,  C,  D,  a,  c  replacing  A,  B,  C,  D,  a, 
c  respectively  where 

max{  UA-Ai ,  HB-BJI,  flC-CI,  ID-DI,  Ha-all,  Ic-cll}  <  6  for  some  6  >  0  . 

Remark  1 .  The  classical  Gordan  theorem  of  the  alternative  is  the  equivalence 
between  the  alternatives  (i1 )  and  (iii)  of  Theorem  1  with  all  data  suppressed 
except  the  matrix  D. 

Remark  2.  Some  classical  existence,  stability  and  perturbation  results  for 
linear  systems  of  equations  follow  from  Theorem  1  by  suppressing  everything 
except  the  matrix  B  and  the  vector  a. 
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3.  Some  applications  of  the  stable  theorem  of  the  alternative 

Theorem  1  can  be  uaed  to  obtain  some  interesting  characterizations  of 
boundedness  and  uniqueness  of  linear  programming  solutions.  In  particular  we 
will  show  (see  the  equivalence  (ii)  <*■>  (v)  of  Theorem  3  below)  that  the 
solution  set  of  a  linear  program  is  bounded  if  and  only  the  linear  program 
remains  solvable  for  all  arbitrary  but  sufficiently  small  perturbations  of  the 
objective  function  coefficients*  It  is  interesting  to  contrast  this  with  the 
uniqueness  characterization  (see  the  equivalence  (ii)  <—>  (v)  of  Theorem  4 
below)  which  states  that  a  linear  programming  solution  is  unique  if  it  remains 
a  solution  to  all  linear  programs  obtained  by  arbitrary  but  sufficiently  small 
perturbations  of  the  objective  function  coefficients. 

We  state  and  prove  now  a  boundedness  characterization  theorem  for  linear 
programming.  A  special  case  of  the  equivalence  below  between  (i)  and  (ii) 
follows  from  Goldman's  results  [5,  Corollary  IB]  and  has  been  given  by 
Williams  [15,  Theorem  3].  However,  Williams'  theorem  is  incorrect  without  the 
additional  unstated  assumption  that  the  primal  feasible  region  is  nonempty  in 
the  first  part  of  the  theorem,  and  that  the  dual  feasible  region  is  nonempty 
in  the  second  part.  The  equivalence  below  between  (i)  and  (iii)  can  also  be 
derived  from  [13,  Theorem  3]. 

Theorem  3  (Boundedness  of  linear  programming  solutions) 
nl+n2 

Let  (g,h)  €  R  and  let 

S  *  {(u,v)|aTu  +  CTv  <  g,  BTu  +  D^v  *  h,  v  >  0} 

— .  T  T 

S(a,c)  ■  {(u,v)|(u,v)  solves:  max  a  u  +  c  v  s.t.  (u,v)  e  S) 

u,v 
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The  following  are  equivalent: 


(i)  S  ia  nonempty  and 

ijl  fp  •p  ^p 

A  u  +  C  v  <  0,  B  u  +  D  v  •  0,  a  u  ♦  c  v  >  0,  v  >  0,  (u,v)  t*  0 
has  no  solution  (u,v). 

(ii)  S(a,c)  is  nonempty  and  bounded# 

(iii)  S  is  nonempty  and  the  following  constraint  qualification  is  satisfied: 
The  rows  of  [A  B]  are  linearly  independent ,  and 
Ax  ♦  By  ■  a,  Cx  +  Dy  >  c,  x  >  0 
has  solution  (x,y)# 

(iv)  There  exists  e  >  0  such  that  S(a,c)  is  nonempty  and  bounded  for  all 

(a,c)  such  that  l(a,c)  -  (a,c)  I  <  e. 

(v)  There  exists  e  >  0  such  that  S(a,c)  is  nonempty  for  all  (a,c) 

such  that  l(a,c)  -  (a,c)l  <  e. 

m 

Proof 

(i)  ■■>  (iv):  Follows  from  the  implication  (L')  mm>  (vii9)  of  Theorem  1  with 

the  extra  condition  that  S  0  imposed  on  both  (i1)  and  (vii1)* 

(ii)  *->  (i):  Obviously  S  (7.  If  there  exists  (u,v)  such  that 

ATu  ♦  CTv  <  0,  BTu  ♦  DTv  ■  0,  aTu  +  cTv  >  0,  v  >  0,  (u,v)  ?  0 

then  for  any  (u,v)  f  S(a,c)  we  have  (u  +  yu,  v  ♦  yv)  e  S(a,c)  for  y  >  0, 

and  hence  S(a,o)  is  unbounded  which  is  a  contradiction. 

(i)  «■>  (ii):  if  (ii)  does  not  hold  then  S(a,c)  is  empty  or  unbounded.  In 
either  case,  since  S  is  nonempty,  there  exist  {(u*,vS),  i  ■  1,2,...,  with 
luSv^l  ♦  •  such  that 


A  u  +C  v 
Ifu^ ,  v**  I 


«ul,vV 


T  i  T  i 
B  u  +D  V 

»U1 ,  fl 


„  i  1/  B  i  i _ 
lu  ,v  I  lu  ,v  I 


T  i  T  i 
.  a  u  +c  v  ^ 

*  i  i  - 

lu  /  v  I 


luSv1, 
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V  «  • 

where  8  ■  max  a  u  +  c  v  if  S(a,c)  ie  nonempty,  while  if  S(a,c>  is 
(U'V)£S  T  1  T  i 

empty  then  since  S  is  nonempty,  a  u  ♦  c  v  ♦  •  and  hence  8  can  be  any 
fixed  real  number*  By  the  Bolzano-Wieirstrass  theorem  then,  there  exists 
(u,v)  satisfying  the  conditions  of  (i)* 

(i)  <•■>  (iii):  Follows  from  the  equivalence  ( i • )  <“>  (iii)  of  Theorem  1. 

(iv)  «■>  (v)s  Obvious* 

(v)  (i):  Obviously  S  is  nonempty*  Since  S(a,c)  is  nonempty  for 
B(a,c)  -  (a,c)l  <  e  it  follows  that  by  linear  programming  duality  that 

Ax  +  By  -  a,  Cx  +  Dy  >  c,  x  >  0  has  solution  (x,y)  for 
l(a,c)  -  (a,c)l  <  €•  It  follows  by  the  equivalence  (i)  <*■>  (i1)  of  Theorem 
1  that  (i)  of  this  thoerem  holds* 

□ 


We  turn  now  to  characterizing  uniqueness  of  linear  programming 
solutions*  In  [9]  uniqueness-characterizing  theorems  similar  to  Theorem  3 
above  were  obained  by  using  theorems  of  the  alternative  subsumed  by  Thedrem  1 
above.  We  give  below  a  slightly  more  general  -esult  than  that  of  [9]  with  a 
considerably  simpler  proof* 

Theorem  4  (Uniqueness  of  linear  programming  solution) 

Let  g,  h,  S  and  S(a,c)  be  defined  as  in  Theorem  3*  Let 
(u,v)  e  S(a,c)  ani  let 

J  -  {i|(ATu  ♦  CTv>i  -  g^ } ,  H  *  {i(vi  *  0},  H  -  {i  t  v^  >  0}  . 

The  following  are  equivalents 

(i)  ( ATu  +  CTv)  <  0  ,  BTu  +  DTv  -  0,  aTu  +  cTv  >  0,  v  >  0,  (u,v)  ?  0 

J  ■  m  H  * 

has  no  solution  (u,v)* 
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(ii)  S(a,c)  ia  a  singleton. 

(iii)  The  following  constraint  qualification  is  satisfied:  The  rows  of 


A  B 

•  J 


c  n 

•X  -v 

HJ  H 


are  linearly  independent  and 


*•*  Xj  *  By  '  *•  *  °sy '  V  C-Xj  *  v ’  v x  0 


has  solution  (Xj,y). 

(iv)  There  exists  e  >  0  such  that  (u,v)  is  the  only  element  in  S(a,c) 

for  all  (a,c)  such  that  ll(a,c)  -  (a,c)  fl  <  e. 

(v)  There  exists  e  >  0  such  that  (u,v)  is  in  S(a,c)  for  all  (a,c) 

such  that  l(a,c)  -  (a#c)H  <  £• 

Proof 

(i)  *»>  (ii):  By  the  second  order  sufficient  optimality  conditions  of 
nonlinear  programming  [7,  Theorem  3.2]. 

(i)  <*«>  (iii):  By  the  equivalence  ( i * )  <**>  (iii)  of  Theorem  1  above. 

(iv)  -*>  (v):  Obvious. 

(ii)  »«>  (iv):  Suppose  not,  then  there  exists  a  sequence  {(a*,cS) 

IT  iT 

converging  to  (a,c)  such  that  the  linear  programs  max  a  u  +  c  v  have 

(u,v)eS 

solutions  (uSv*),  i  -  1,2,...,  (this  follows  by  the  implication  (ii)  **> 

(v)  of  Theorem  3  above)  which  are  distinct  from  (u,v).  Hence  the  sequence 
{(uSv1)}  satisfies  for  i  -  1,2,..., 


iTi-  iTi—  t  i  —  t  i  — 

a  (u  -u)  +  c  (v  -v)  >  0,  (A  (u  -u)  +  C  (v  -v))  <  0, 

a  J  a 


BT(u^-u)  +  D  (v^-v)  *  0,  (v*-v)  >  0. 

H  * 
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Dividinq  by  lu*-u,  v*-vl  and  using  the  Bolzano-Wieirstrass  theorem  gives  a 

(u,v)  satisfying  the  conditions  of  (i)  and  hence  for  sufficiently  small 

X  >  0,  (u  +  Xu,  v  +  Xv)  is  in  S(a,c)  which  contradicts  (ii). 

(v)  “>  (i):  Suppose  not,  then  there  exists  (u,v)  such  that 

(ATu  ♦  CTv)  <  0,  BTu  +  DTv  0,  aTu  +  cTv  >  0,  v„  >  0,  (u,v)  ft  0 

Consider  now  the  linear  program  min  (a  +  6u)Tu  +  (c  +  6v)Tv.  For  all 

(u,v)€S 

sufficiently  small  5  >  0  we  have  that  (u  +  5u,  v  +  6v)  e  S  and 

(a  +  6u)T(u  +  6u)  +  (c  +  6v)T(v  +  6v) 

a  t—  A  T  ^  2  aT  a  aT  a 

■  (a  +  6u)  u  +  (c  +  5v)  v  +  6(a  u  +  c  v)  +  <$  (u  u  +  v  v) 

>  (a  +  +  (c  +  Sv)^  • 

This  shows  that  for  all  5  >  0  sufficiently  small,  (u,v)  is  not  in 
S(a  +  <5u,  c  +  <5v),  which  contradicts  (v). 

□ 

It  is  interesting  to  note  the  similarities  between  the  five  conditions 
(i)  to  (v)  of  Theorem  3  and  4  and  also  to  note  the  replication  of  the 
boundedness  or  uniqueness  conditions  of  (ii)  in  the  oerturbed  problem  of  (iv). 

Finally  we  mention  that  an  interesting  practical  application  of  the 
Theorem  1  has  been  made  in  the  design  and  control  of  a  heat  exchanger  network 
[10].  In  particular  the  theorem  is  used  to  give  conditions  under  which 
maximum  energy  recovery  is  possiMo  in  a  heat  exchanger  network  under  a 
certain  disturbance  range. 
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